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THE IMPACT OF SOLDIER QUALITY ON PERFORMANCE IN THE ARMY 



EXECUTIVE SUMMARY 



Requirement: 

The Army has been 8ucces8£a3. tn improving its manpower quaiity o^r the 
last several- years* Recruits are scoring hi^er on the Armed Forces Quali£ica<-' 
tioh Test (AFgT) and are more likely to have high 8chcK)l diplomas tHan in any 
year since the inception of the All-Volunteer Force. Recruiting such person- 
nel is es^nsive^hwevexTr as the Arm from the _ 
ci^lian labor market^ educationa and the other_ser^ces for a__ 
shrinking youtii population. In order to justify its manpower requirement^ the 
Army pist be e^le tp-demoiuitrate an empirical link between AFQT scores and sol- 
dier perfoinnance: ^ A^ is designed to measure traihribility. its 
value as a predictor of perfbr^^ ei^irically verified. This re- 
search presents evidence oh that. relationship using data from several sources: 
the ^my*8 teainlhg schools and Skill Qaalificatioh Tests (SQ^)« 



Procedure: 

___ The performance measures are modeled in a multivariate regression models 
using an instrumental variables technique to correct for measurement error in 
the AF^ variable « Other es^lanatory variables are sex, race^ education. Army 
experience, and training. 



Findings : 

^e results of the analysis on the TRASMa training data and the 1983 _ 
skill level two SQT data demnstr ate that AFQT, a measure of tr 
a significant predictor of performance in the Army, the performance and skill 
n^asures used iii this study are if^rfect, but the consistency of the relation- 
ship acr oil t^es of perfprtnanbe measures and across MOS is impressive^ The 
analysis of the SgT data is reported for several large representative MOS, but 
^e patterais also cohsistentfb^ almost. all MOS having sufficient observa- 
tions to permit atxiaij^is* Hblding the effect of btiter_ variables c6hstaht> AFQT 
exerts a positive and significant influence on Airmy performance. No o^ 
variables are consistently significant across all MOS in both data sets. These 
findings ari consistent with ahb^er study that also documented the positive 
impact of AFgT scores on Army soldier performance for tankers. 



Utilization of Findings: 



The -^pirical analysis demoi^trates tdiat AFQT scores are indeed a signif- 
icant and consistent determinant of Army performance for a variety of perfor- 
mance measures. The equations indicate how much additional per fbrmance, on 
average, is associated with an increase in AFQT scores « Axis information 
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SI^JS =^f!? ^^^^'^ "cmtihg.fiigh^iitty miftfwwer, because 

the^higher recruiting costs are offset By increiied labor groauctivity. Ear- 
ner vBrsion8_of ^is analgia done in. cbiiabojfation with HRJ Thomas D^ul^ 
were used by the Army to suEPbrt curreSt quatity-recruiting goals before 
SUrr^ Defense Manpo>>er pualtty, Report to the House and Senate commit- 
tees on Armed Services, Volume 11, May 1985, appendixes E ^d I. 
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Th« Impact of Soldier Quality on Performance In the Army 



David k. Home* 



The productivity of an indiviHual oh the job depends upon such dhohservable 
personal attributes as ability, n^flvation, physical coordination, and other joh-*specifIc 
sicijjs« Employers who lack information oh the potehtiai productivity of job applicants 
may use various proxies for these skills* Education, for example, may be ah ihdicator of 
productivity if individuals learn skills in school which may be applied to the }ob» This is 
the assumption of the Human capital mbdeU^ Alternatively, if individuals with more 
'ability' are more likely to Itave additional education through a sorting mechahism, 
education and productivity will be positively correlated. Employers may then use 

__: __ 2~ — — - --- -- 

education to screen applicants*^ Education^ experience^ scholastic achievement and other 
productivity proxies may be useful for predicting performahce oh the job. 

One alternative to using general performance or skill proxies is to develop 
instruments which could be expected to predict performance* For example, college 
ehtrance exarhs are used to predict scholastic success* Ahother exarhple Is the test 
which the Armed Forces administer each year to hundreds of thousands of youths^ The 
Armed Forces Qualifications Test (AFQT) is designed to measure the traihaHility of 
applicahts* The test Is used by all the services to screeh out individuals who rhight be 
expected to fall training in their MOS* (Army }ohs are classified into Military 
Occupational Specialties (MOS))* 



* U.Si Army Research institute, 5001 Eisenhower Avenue, Alexandria, VA 22333* The 
author is grateful to MAJ Thomas Daiila for helpful suggestions^ and to colleagues for 
comments on an earlier version* The views expressed are solely those of the author* 
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This screehihg device can be defended only if a reiatidhship exists between the test score 
and Job or MOS perfbrrnance^ since the object fve of the selection process is to acquire 
recruits who will perform well as soldiers rather than as students^ this analysis 
demonstrates that AFQT score is positively reiated to M OS-specific performance* tliis 
conclusion has specfic policy Implications. Current Army recruiting policy requires 
substantial resources to attract high-scoring recruits, turning away many individuals who 
desire to ehiist but who do poorly oh the AFOf. the emphasis on the so-*caiied high 
quality recruits can only be |ustffied If AFQT scores can be shown to be a determinant of 
productivity* 

Section 1 discusses the methods and uses of the AFQt and peformance tests in the 
Army* Section 2 contains a discussion of the model and the data i^sed in the analysis* 
The results are discussed in section 3* Policy Implications and conclusions are presented 
in section 4* 



Abiftty and Performance 

The purpose of this analysis is to relate the Army's measure of trainability to job or 
M6S performance measures* The trainability measure will he discussed first, followed by 
a discussion of performance measures* 



J^SlIity Measurement 

One can argue that 'ability* is too broad and amhfgubus to be measured well on a 
one-dimensional scale* Nor is ability the Army's primary concern* The Army takes 
recruits^ many with no prior wbric experience^ and trains them in a particuiar MOS* 
Advanced individual training is accbmplished subsequent tb basic training and may last 
from as little as six weeks to as long as six montlis or more* The concept of trainability 
is weli defined* the AFQt is designed to be a general measure of trainability and is 
composed of a number of sub-tests of the Armed Services Vocational Aptitude Battery* 
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Other combfnations of subtests^ known collectively as aptitiirle area C9mpbsltes> are 
created id measure more narrow types of aptitude for mechanical, electronics, clerical 
arid other areas* 

individuals tested are assigned scores In percentile terms rcflatlve to the 1980 youth 
population of 18-23 year olds. By law the applicants must score above the 9th percentile 
to be eligible iror enlistment, the number of applicants who can be recruited in the lOth 
tlirough 3bth percentiles, particularly without a high school diploma, is also limited by 
Congressional mandate. However, the Army attempts to recruit above-average (AFQT 
of 50 or above) Individuals whenever possible, the percentage of non-prior service 
regular Army recruits scoring in the top 50 percentiles has risen from 26.0 percent in 
fiscal year 1980 to 63.4 percent in fiscal year 19S4. Over the same period the number of 
male recruits with high school diplomas has risen from 48,9 percent to 89.4 percent, this 
trend can be attributed partially to changes in recruiting practices as wef J as to changes 
in the recruiting marlcet. 

Recruiting high quality individuals, defined both in terms of APQt scores and high 
school diploma status, Is particularly expensive. Substantial recruiting resources are 
devoted to attracting these individuals to the Army> because the Army faces 
considerable competition from educational iristftutlbris, the c!v!l!an labor market, and 
other services. At the same time, tlie Army turns away many lower quality applicants 
who could be obtained at a much lower recruiting cost. 

there are two easily identified behefits to recruiting high quality Iridlvlduals. 
these recruits tend to complete their tours more often than lower category recruits. It 
is costly for the Army to recruit and train soldiers who leave the Army before 
completing the toiir.^ Attrition rates have reached 30 percent in recent years, the 
second benefit is performance. As equipment used in the Army becomes increasini^ly 
sophisticated, increased productivity In Army manpower will translate into cost sav.ngs 
and increased force readiness. Unfortunately, neither productivity nor performance can 
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be easily measured* 
PerfoffflMce Measures 

Manpower productivity in tlie Army is not easily defined. Soldiers trained for 
combat might be considered most successful if they are a deterrent to war. Skills which 
may be valuable during peace may be less valuable during combat, while combat skills 
may produced little 'output* during peacetime. However, other things constant, the 
Army should prefer soldiers who can operate or maintain equipment to those who cannot, 
or soldiers who can successfuily distinguish between friendly and hostile aircraft and who 
can hit targets to those who cannot. Although the value of 'output* is difficuit to 
ascertain, the Army does evaluate soldier proficiency, these proficiency tests may be 
considered one type of perfbrmahce measure. 

This study uses two performance measures. The first source is composed of test 
scores on a variety of written and hands-on tests from the Army's training schools. The 
tests will be discussed in more detail in the next section. The AFQT was originally 
validated on training data and should be positively associated with the training test 
scores. 

The second performance measure used In this study Is the Skill Qualifications test 
(SQT). The SQT is currently a written (multiple choice) test created by subject matter 
experts for each MOS (except for a number of exempt MOS). A SQT is given each year 
at four different skill levels which correspond to experience. The skill level 1 test is 
administered to soldiers through the E-4 grade. The skill levels 2 through 4 are given to 
grades E-5, E-6, and E-7 respectively. Soldiers are tested on MOS-speclflc tasks wh^'-h 
are contained in the Soldier's Manual for each MOS. 

The SQTs are not direct performance measures, ftather^ they measure skills and 
knowledge required for performing the tasks, it is reasonable to assume that soldiers 
who score higher on the SQT, other things equal, will demonstrate better performance In 
the field. 
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However^ the SQTs suffer from a number of Hef iciencies. A U.S. General 
Accddntihg Office report noted that the SOT Is used Hy the Army for two somewhat 
inconsistent fanctions^* the SQts were originally developed to evaluate training 
programs and to indicate deficiencies in training* The tests are also used for personnel 
evaluations. The test score is recorded on soldier's personnel files and is used for 
promotion decisions* A score of 80 is required for prbmbttbh unless a waiver Is 
dbtalned. Because commanders are responsible for preparing their troops to do well on 
the SQT for their personnel evaluatibhs, training becomes directed toward Imprbvihg 
evaluations rather than imprbving skills, and both functibns bf the SQTs become less 
effective. 

Before the SQTs are administered each year> soldiers are given a list of the critical 
tasks on which they will be tested. Those soldiers who receive refresher training may 
train specifically for those tasks, and training often occurs just prior to the SQT 
testing. Therefore the annual refresher training designed to maintain skills is largely 
directed towards passing the current SOt. In addition, analysis of Army persbnhel files 
indicates many missing values for SQT scores. About 30 percent of the enlisted 
personnel files fbr E-5 had nb SQT scbre by the end of 1984. 

in spite of problems with the SQT, the test does provide a measure of skill 
ichbwiedge for a wide range of MOS. The direct link between SQTs and actual job or MOS 
proficiency Is nbt bbserved. Hbwever, given the nature bf the tests. It seems reasonable 
to assume that soldiers who demonstrate greater skill knowledge on the SQTs will 
generally be more productive in the MOS. Numefbus other personal attril-yutes^ sbme 
bbservable arid sbme uribbservable, will also Irifluerice prbductlvlty. We attempt to 
control for some of the observable characteristics in the regression equations. 
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The Model 



There are a humBer of variables which are associated with prddtictivlty Vn the 
human capital and signalling models. Experience for example, should increase job siciils 
because training takes place over time* Education may provide marketaHie skills and 
may also act as a sorting mechanism. In this sample of enlisted soldiers there is little 
variance in years of education, but variation in high school diploma status does exist. 
Graduates are probably more motivated and goal oriented. 

The type of training received by soldiers is also an Important determinant of 
productivity. Information is not available on the quality of training. But It is possible to 
distinguish between soldiers who have been assigned to MGS In which they received their 
training and those who have been assigned to MOS for which they were not trained. 

Several demographic variables included in this analysis are likely to influence SOT 
scores. Opportunities for education, training or employment In the civilian sector may 
differ by race or sex. The propensity or taste for military service may also differ 
between these groups* The other variables included in the model cannot fully correct for 
these unobserved differences between groups. Therefdre both sex and race may be 
significant variables in the equatidns* 

The general model is specified In the following form: 

1. Performance-f(f rainabiiity. Education, Experience, Training, Sex, Race). 

The variables used as measures of these are: 

Performance: f raining Data, SQT scores 

Trainability: A FQT scores 

Educatidh: High School diploma status 

Experience: Months In service, rank 

Training: Training in same MOS 

Sex: Sex 

Race: White or non-white 
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The maior relatibhships of interest in this researcn is between tralnabilitv and 
performance. AFQt is an accepted measure of trainabillty. More trainable persons are 
more likely to acquire the skills and knowledge required to perform their military 
assignments. AFQT may also reflect abilities other than those required for training 
success which contribute directly to performance. This analysis does not distinguish 
between the two processes. 

Other variables, such as education and experience, may also contribute to job 
performance. These variables may have a direct effect on performance because they are 
correlated with skills or khowiedge or ability. Such variabies may also have ah indirect 
through the AFQT variable: more education Is associated with higher AFQT scores, for 
example. The purpose of using multivariate regression estimation is to measure the 
direct contributibh of each variable. Exciudihg variables such as education or experience 
which may be significant determinants of performance leads to omitted variable bias - 
the estimates of the impact of AFQt wMl be biased. This estimation problem has policy 
repercussions. If AFQT is pbsitiveiy correlated with experience and education, for 
example^ a univariate regression of SQT score against AFQT score will exaggerate the 
effect of the AFQT variable, the considerable cost of administering the AFOT and of 
recruiting high-scoring individuals can only be defended if AFQT has ah effect oh 
performance independent of other variables. If AFQT is a proxy for education, for 
example, then education and not AFQT score should be the selection criterion. 
Therefore, neither simple correlations or univariate regression results cah be used to 
defehd mahpower quality goals specified in terms of AFQT scores. AFQT score is only 
appropriate as a selection criteria If the It contlbutes to soldier performance Independent 
of other variables. 

Estimation of the r latibhship betweeh performance and the explahatbry variables 
is complicated by the fact that AFQT score Is an Imperfect measure of ability or 
tralnablllty. Therefore the observed data matrix, X, consists of the true data X plus a 
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measurement error term V; 



2. X s X 4 V. 

The true model may then be expressed as 

3. y=iXB + i = XB4.(i -VB), 

where y and u denote the independent variable and errc\ matrices respectively, the 
least-squares estimator of the true coefficient is 

4. i a (X X)"^ x'y. 



Johnson has demonstrated that the ordinary least squares estimator of # given In 
equation 4 Is inconsistent and asVmj3tdtically biased because the observed data matrix is 
correlated with the error term^^ One method to correct for the errors-in-variables Is the 
Instrumental variables (IV) technique. An instrumental variables estimator will he 

consistent and asymptotically uhbalsed. If the matrix Z Is an Instrument which is 

_- " _____ 

uncorrelated with the errors such that pllm (1/n Z u) =0, the IV estimator of 

9 is b, where 

5. b = (z'x)"'' z'y 

and the asymptotic variance of b is 

6. asy var (b) » (z'x)"'' z'z (x'z)"''. 
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where r denotes the variance of the error term (u}« 

the instrument chosen for AFQT score in this study is the rahlc ordering of scores^ 
where the lowest score receives a value of one and the highest score receives a valu^ of 
ru this is shown as a Ourbirt instrument^* This instrument is correlated with AFOt 
scbre^ but Is uhcbrrelated with the errors* The other explanatory variables are used as 
their own instruments* 

Data 

This analysis uses two data sets^ The first data set is training data for selected 
MOS. The second data set includes SQT scores from the 1983 test* 

Tialnlng Datii 

The training data (from the Army training Centers) ihciuded a number of MOS 
from several missile systems* The PERSHING II missile data covered basic maintanehce 
testing for MOS ISE and 21G (MOS descriptions are provided in the appendix) and was 
created from mujtipie-*choice questions* the StlNGER antiaircraft system (MOS 16S) 
testing ihciuded a written test on system knowledge, preventive malhtahence, system 
characteristics and other operations; a range ring profile test of aircraft type, range ring 
coverage^ and correct action; two visual aircraft recbghitibn tests (photo test and test 
from slides) and two harids'-oh tests* The first hahds*-6n test was probability of 
completing launch sequence in a moving target simulator, the second was time-to-fire* 
The LANCE testing consisted of several tests for MOS 15D and 15 J* the written test 
questions were talceh f rom LANCE manuals and SQTsi A map reading test consisted of 
17 multiple choice questions^ Each LANCE MOS was also given hands*-on operations and 
malhtahence tests* the MAWK missile system MOS were given written and hands-on 
tests for general equipment knowledge (16D & 16E) and equipment maintanence (24C, 
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24 E, 24G)^ 

these hand-on tests are MOS-speclflc. Soidiers responsible for maintenance, for 
example^ are asked to perform system checks, or to diagnose and repair faults which 
have been Inserted In the equipment. Operators are asiced to Identify aircraft from 
pictures or slldi»s, make the correct firing decision, and complete the launch sequence. 
The tests are carried out at the cralnlng centers and are designed to reflect the tasks 
which the soldiers will perfnrr/i. The tests are created with the assistance of system 
experts^ 

The training data set contains a numSer of variables which may be used as 
explanatory variables In the regession. These Include sex, race, education, and training 
information for each soldier. Limited information on length of service, which Is an 
experience proxy. Is available for some of the MGS* Much of the time-ln-servlce data Is 
missing, but rank data are availably Rank Is largely a function of time In service, 
though more productive soldiers should be expected to be prdrhdted more rapldly^i 
Therefore rank should, and In fact does apipear to, have more explanatory power than 
time in service alone. Rank cannot be strictly Interpreted as an experience variable, but 
is used as a proxy for experience. This variable is used in the training regressions^ 

The education variable has little variation. Few members of the sample have 
attended college. Past research has shown that the education variable which appears to 
have the most impact on soldier behavior Is high school diploma status. This is not only 
ah indicator for the amount of education, but may also reflect an individual's tenacity 
and determination to reach goals. The training variable {SAM EM OS) Indicates whether 
an Individual received training in the same MOS covered by the SQT test. Generally, one 
would expect that training In the same MOS, high school diploma and rank should all 
exert a positive influence on SQT score. 

The tralnabliity variable used In this study Is AFQT score. The applicants are 
required to take the AFQT to enter the Army, so- scores should be available for each 
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soldier. Soldiers who took the AFQT driginally between 1976 and 1980 receivrH scores 
that were misndrmed^ but they have been reriormed for this analysis* MOS performance 
can be cbhsfdered the joint batput of trainability of the individual and the training 
program. Given a fixed training program, the AFQT score is expected to have a positive 
impact oh MOS performance* 

Some assumptions behind the analysis should he made expllcU In particular, the 
training program is held constant* It is liicely that changes in the training program will 
affect the impact of AFQT oh performance* The more effective the trainihg program^ 
the more proficient the soldiers should become. Trainability could become less 
important as training effectiveness improves, though some tradeoff between trainability 
and perfbrmahce woiild be ari«.icipated with ahy traihihg program* The estihiated impact 
of AFQT on these performance measures Is cohditlbhal on the traihihg received by the 
soldiers* Consistent AFQT effects across MOS would indicate that the tralnahilitv is 
important vnder a range of training programs* 

SQT Data 

The SQT analysis utilized the skill level 2 SQTs (rank E-5}* Many of those who had 
taken skill level 1 SQTs had taken different versions of the AFQT which are hot strictly 
comparable, though preliminary analysis showed that these SQT results were similar* 
The SQt level 3 and 4 samples were relatively small* A sample of almost 53,000 
observations was available for skill level 2 tests* 

SQT scores are recorded ih the Army's ehlisted persohhel files, called the Enlisted 
Master File (EMF)* Other available variables that could be expected to Influence 
performance include AFQT scores^ education, tralhing^ race^ ahd time*in-service* The 
variables used ih the regression ahalysis are similar to those used ih the traihihg data 
analysis* the results for several large, representative MOS are presented in this paper; 
these are generally consistent with the results for other MOS not reported here* The 
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MOS descriptions are provided in the appendix. 

Results 

t rain i^ Jl^suto 

The Training equations are provided In Tables 1 through 3 for several weapons 
systems: the HAWK, STINGER, PERSHINC II, and LANCE, the equations for the two 
types of tests, written and hands-on, are provided separately. 

the results of the written tests (shown in Table 1) demonstrate that the AFQT 
variable is consistently significant across systems and MOS. the laclc of a high school 
diploma is significantly negative In only one equation. Rahic is always positive and 
generaiiy significant. The race coefficient varies, being significantly positive In one 
equation and negative In two. The training In the 'AOS has mixed effect. 

The two variables which stand oat consistently are AFQT score and rank. In the 
written tests^ AFQT score Is positive and significant in 10 of 11 equations, while rank is 
PMitive and significant in 9 of the equations. No other variables are as consistent across 
equations, either in sign or significance. Trainablllty and experience appear to be the 
major determinants of the written test scores In these equations. 

The hands-on tests which are reported In tables 2 and 3 are less conclusive. AFQT 
is significantly positive In 6 of the 11 equations. The pattern is similar for rank. The 
negative coefficient for the time-to-fIre test Is consistent with the other results, since 
brighter and more experienced soldiers should be able to fire the mechanism In less 
time. The effect of the other variables tends to vary across MOS. 
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the SQT results are demonstrated for several MOS which are generally 
representative of MGS witfiin the Army^ and which are of sufficient size to provide more 
precise parameter estimates* The results, shown in Table 4, are In many ways similar to 
the training results. The AFQT variable is significant and positive in all the MOS, with 
the coefficient ranging from ^07 to .26. The Cdefficient of .26 Implies that for each 4 
additional points on the AFQT scored by a soldier, one would expect the SOt score to 
increase by about 1 point on average. 

The high school diploma variable Is less important than the AFQT variable as a 
predictor of SQT scores. The lack of a diploma is insignificant in all of the six 
equations, the signs of the other variables are generally cbhsisteht across equations, 
the experience variable, time-ih-^ervice, has a positive effect, as does training In the 
same MGS (SAM EM OS). The effect of sex generally varies across MOS. The race 
variable Is significant in four of the six equations; the non-white group has a negative 
impact. 

Conclusions 

The results of the analysis on the TRASANA training data and the 1983 skill level 2 
SQT data demonstrate that AFQt, a measure of traihahlilty, is a significant predictor of 
performance in the Army. The performance and skill measures used In this study are 
imperfect, hut the consistency of the relationship across types of perfornance measures 
and across MOS is impressive. The analysis of the SOt skili level 2 data is reported for 
several large representative MOS, but the pattern Is also consistent for almost all MOS 
having sufficient observations to permit analysis. Trainability, as measured by AFQt, 
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exerts a positive and significant influence on Army SQT performance, hoidirig the effect 
of btfier variables constant* No other variables appear to be consistently significant 
across all MOS In both data sets. These findings are consistent with another study which 
also documented the positive impact of AFQT score on Army soldier performance for 
tankers ^* These results support the use of AFQT as a screening device for Army 
applicants. 

The analysis implicitly assumes that training policies remain stable and that 
increased manpower performance can be attained by attracting higher quality recruits. 
The returns due to changes in quantity or quality of training cannot be estimated In this 
framework. If training policies were significantly altered^ the relationship between 
AFQT and performance might be expected to change, although the direction of the 
change cannot be predicted a priori, the performance measures themselves are also 
likely to change over time. Yet evidence of a positive relationship between performance 
and skill measures on the one hand, and the AFQT on the other, is fairly convincing. The 
impact of other variables on performance Is less consistent, the high school dlplorria 
generally does exert a positive impact on performance, as does experience and M OS- 
specific training. 
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Appendix 

MOS Descriptions 



HQS Beserlptloti 

05c Radio Operator 

llB Infantryman 

15D Lance Crewmeiiiber 

1^ Pershing Missile Crewmeraber 

161> Hawk Missile Crewman 

16E Ifawk Fire Control Crewraember 

Stinger Crewman 

21G Pershing Electric Maintenance Specialist 

2*C ttawk Firing Section Mechanic 

2^ Hawk Cbbrdlhatldn Central Mechanic 

Light Vehicle/Power Generation Mechanic 

75B Personnel Administration Specialist 

5*B Pood Service Specialist 

S^8C Electronic Warfare /Signal Intelligence V 
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